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EXECUTIVE  SUMMARY 


N. 

Visibility  and  Management  of  Operating  and  Support  Costs  7 ,  < 
is  a  program  initiated  by  the  Office  of  the  Secretary  of  Defense 
(OSD)  in  order  to  ensure  that  each  Military  Department  gathers, 
tracks,  and  computes  operating  and  support  costs  by  weapon  system. 
VAMOSC  II  is  an  Air  Force  management  information  system  which  is 
responsive  to  the  OSD  initiative.  It  uses  information  from 
existing  Air  Force  systems  to  satisfy  both  Air  Force  and  OSD  needs 
for  certain  weapon  system  operating  and  support  (O&S)  costs. 

At  present,  the  VAMOSC  II  system  comprises  three  subsystems: 

(1)  The  Weapon  System  Support  Cost  (WSSC)  system  (D160) , 
which  deals  with  aircraft, 

(2)  The  Communications  -  Electronics  (C-E)  system  (D160A) , 
which  deals  with  ground  communications  -  electronics 
equipment , 

(3)  The  Component  Support  Cost  Subsystem  (CSCS)  (D160B) , 
which  deals  with  subsystems  and  components  for  aircraft. 

The  Component  Support  Cost  System  (CSCS)  of  VAMOSC  II  gathers 
and  computes  support  costs  by  assembly /subassembly  and  relates 
those  costs  back  to  the  end  item  or  weapon  system.  CSCS  replaces 
the  Logistic  Support  Cost  (LSC)  model  of  K051  (AFLCR  400-49)  for 
aircraft  and  engines. 

The  CSCS  receives  inputs  from  15  Air  Force  data  systems.  On 
a  quarterly  basis,  the  system  provides  two  standard  reports  each 
processing  cycle  and  twelve  other  types  of  reports  as  requested 
by  users.  It  also  provides  pre-programmed  data  base  extracts  on 


magnetic  tape  on  a  one-time  basis  in  response  to  user  requests. 

Special  requests  for  data  in  user  selected  format  may  also  be 
satisfied  on  a  case  by  case  basis. 

At  the  heart  of  the  CSCS  is  a  set  of  30  algorithms  for  esti¬ 
mation  or  allocation  of  costs.  Information  Spectrum,  Inc.  ( IS I ) 
was  awarded  a  contract  to  validate  these  algorithms.  This  effort 
included  investigations  of  logic,  appropriateness  of  the  algo¬ 
rithms  and  assumptions  inherent  in  the  algorithms.  IS I  was  also 
to  survey  published  findings,  reports  of  audit,  etc.  relating  to 
the  accuracy ^fco  the  source  data  systems.  In  addition  to  the  algo¬ 
rithm  validation,  ISI  was  to  perform  certain  "special  tasks," 
including  a  user  survey. 

This  report  provides  the  verification  and  validation  of  an 
algorithm  called  "Depot  TCTO  Material  Costs."  Time  Compliance 
Technical  Orders  (TCTOs)  are  "directives  issued  to  provide  instruc¬ 
tions  to  Air  Force  activities  for  accomplishing  'one-time'  changes, 
modifications,  or  inspections  of  equipment,  or  installation  of  new 
equipment."  All  TCTO  material  is  provided  in  the  form  of  kits. 

This  algorithm  simply  aggregates  the  kit  costs  from  another  data  system. 

In  order  to  verify  and  validate  the  CSCS  algorithms,  a  set  of 
analysis  procedures  applicable  to  all  of  the  algorithms  was  estab¬ 
lished.  These  procedures  were  then  applied  to  each  algorithm. 

This  report  first  describes  the  analysis  procedures,  without 
reference  to  the  specific  algorithm  addressed  by  this  report. 

Next,  “the  Depot  TCTO  Material  Corts  algorithm  is  defined  and 
described  in  detail.  This  description  includes  identification  of 
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source  data  systems  and  files,  and  the  calculation  procedures 
currently  implemented  by  the  CSCS. 

Finally,  ^  critique  of  the  algorithm  is  provided  as  required 
by  the  contract.  It  addresses  the  following  topics: 

o  Verification  of  assumptions  and  approximations  for 
appropriateness  and  accuracy. 

o  Validation  of  accuracy  of  source  data. 

o  Validation  of  appropriateness  of  source  data  as  inputs 
to  CSCS  logic. 

o  Investigation  of  accuracy  and  appropriateness  of 
algorithms . 

o  Consideration  of  replacement  of  indirect  cost  methods 
with  more  direct  ones. 

o  Identification  of  algorithm  impact  on  CSCS  output 
reports. 

For  each  algorithm  addressed,  ISI  is  required  to  affirm  the  pro¬ 
cess  or  procedure  and  reject  any  portion  that  cannot  be  affirmed. 
Where  the  algorithm  or  portion  of  the  algorithm  is  rejected,  an 
alternate  procedure  must  be  specified. 

For  the  Depot  TCTO  Material  Costs  algorithm,  all  aspects  are 
affirmed.  It  is  recommended  that  the  algorithm  be  retained  in  its 
present  form.  _ _ 
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1.0  INTRODUCTION 


Visibility  and  Management  of  Operating  and  Support  Costs  is 
a  program  initiated  by  the  Office  of  the  Secretary  of  Defense  (OSD) 
in  order  to  ensure  that  each  Military  Department  gathers,  tracks, 
and  computes  operating  and  support  costs  by  weapon  system  (all 
costs  are  computed  and  portrayed  in  "then  year"  dollars) .  VAMOSC 
II  is  an  Air  Force  management  information  system  which  is  respon¬ 
sive  to  the  OSD  initiative.  It  uses  information  from  existing 
Air  Force  systems  to  satisfy  both  Air  Force  and  OSD  needs  for 
certain  weapon  system  operating  and  support  (O&S)  costs. 

At  present,  the  VAMOSC  II  system  comprises  three  subsystems: 

(1)  The  Weapon  System  Support  Cost  (WSSC)  system  (D160) , 
which  deals  with  aircraft, 

(2)  The  Communications  -  Electronics  -  (C-E)  system  (D160A) , 
which  deals  with  ground  communications  -  electronics 
equipment , 

(3)  The  Component  Support  Cost  Subsystem  (CSCS)  (D160B) 
which  deals  with  subsystems  and  components  for  aircraft. 


1. 1  The  Component  Support  Cost  System 

The  Component  Support  Cost  System  (CSCS)  of  VAMOSC  II  gathers 
and  computes  support  costs  by  assembly/subassembly  and  relates 
those  costs  back  to  the  end  item  or  weapon  system.  CSCS  replaces 
the  Logistic  Support  Cost  (LSC)  model  of  K051  (AFLCR  400-49)  for 
aircraft  and  engines. 
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The  objectives  of  the  Component  Support  Cost  System  are: 

(1)  To  improve  the  visibility  of  aircraft  and  engine  com¬ 
ponent  support  costs  and  to  relate  those  costs  to  the 
end  item  or  weapon  system. 

(2)  To  improve  the  Life  Cycle  Costing  capability  for  the 
Air  Force  and  the  Department  of  Defense  in  the  acqui¬ 
sition  of  new  weapon  systems. 

(3)  To  assist  in  the  design  of  new  weapon  systems  by  pro¬ 
viding  cost  information  on  existing  weapon  systems, 
thereby  enhancing  design  tradeoff  studies. 

(4)  To  provide  historical  cost  information  at  the  weapon 
system  level  to  improve  logistic  policy  decisions. 

(5)  To  identify  system  component  reliability,  effective¬ 
ness,  and  costs  so  that  high  support  cost  items  may 
be  identified  and  addressed. 

The  CSCS  is  described  in  detail  in  references  [1],  [2],  and 
[3].  It  receives  inputs  from  15  Air  Force  data  systems.  On  a 
quarterly  basis,  the  system  provides  two  mandatory  reports  each 

processing  cycle  and  twelve  other  types  of  reports  as  requested 

by  users.  It  also  provides  pre-programmed  data  base  extracts  on 
magnetic  tape  on  a  one-time  basis  in  response  to  user  requests. 

Special  requests  for  data  in  user  selected  format  may  also  be 

satisfied  on  a  case  by  case  basis. 


The  twelve  reports  mentioned  above  are  of  primary  interest 
to  the  user  community.  They  are  identified  by  name  in  Table  1. 
Descriptions  and  samples  are  provided  by  reference  [1]. 

At  the  heart  of  the  CSCS  is  a  set  of  30  algorithms  for  esti¬ 
mation  or  allocation  of  costs.  The  algorithms  are  identified  by 
name  in  Table  2.  Information  Spectrum,  Inc.  (ISI)  was  awarded  a 
contract  to  validate  these  algorithms.  This  effort  includes 
investigations  of  logic,  appropriateness  of  the  algorithms,  and 
assumptions  inherent  in  the  algorithms.  ISI  was  also  to  survey 
published  findings,  reports  of  audit,  etc.  relating  to  the  accuracy 
of  the  source  data  systems.  In  addition  to  the  algorithm  valida¬ 
tion,  ISI  was  to  perform  certain  "special  tasks,”  including  a  user 
survey. 

1.2  Overview  of  the  Algorithm 

This  report  provides  the  verification  and  validation  of 
algorithm  19  of  Table  2,  "Depot  TCTO  Material  Costs."  Time 
Compliance  Technical  Orders  (TCTOs)  are  identified  in  reference 
[32]  as  the  media  to  provide  instructions  to  Air  Force  activities 
for  accomplishing  or  making  a  record  of  "one  time"  changes  to 
standard  systems,  equipment,  materials,  munitions,  and  computer 
programs  or  for  imparting  precautionary  instructions  relating  to 
safety,  limitations,  or  inspections  of  system/equipment  or  muni¬ 
tions.  Compliance  is  required  within  specified  time  limits. 

Material  required  for  TCTOs  is  issued  in  the  form  of  kits, 
each  containing  all  parts  and  materials  (except  for  petroleum 
products  such  as  jet  fuels,  lube  oil,  and  solvents)  required  to 
complete  the  TCTO  instructions  on  one  end  item  or  article  of 


TABLE  1 .  CSCS  OUTPUT  REPORTS 


Number*  Name 

8105  Cost  Factors 

8104  MDS  Logistics  Support  Costs 

8106  Base  Work  Unit  Code  (WUC)  Costs 

8107  Total  Base  Work  Unit  Code  (WUC)  Costs 

8111  Depot  On-Equipment  Work  Unit  Code  (WUC)  Costs 

8108  Total  Base  and  Depot  Work  Unit  Code  (WUC)  Costs 

8109  NSN-MDS-WUC  Cross-Reference 

8110  MDS-WUC-NSN  Cross-Reference 

8112  Logistic  Support  Cost  Ranking,  Selected  Items 

8113  Summary  of  Cost  Elements 

8114  NSN-WUC  Logistics  Support  Costs 

8115  Assembly-Subassembly  WUC  Costs 


*  CSCS  output  reports  are  assigned  Report  Control  symbol 
HAF-LEY ( AR ) nnnn ,  where  nnnn  is  the  number  in  the  table. 


4 


TABLE  2 .  CSCS  ALGORITHM  NAMES 

1.  Base  TCTO  Labor  Cost 

2.  Base  TCTO  Overhead  Cost 

3.  Base  TCTO  Material  Cost 

4.  TCTO  Transportation  Costs 

5.  Base  Inspection  Costs 

6.  Base  Other  Support  General  Costs 

7.  Base  Labor  Costs 

8.  Base  Direct  Material  Costs 

9.  Base  Maintenance  Overhead  Costs 

10.  Second  Destination  Transportation  Costs 

11.  Second  Destination  Transportation  Costs  (Engine) 

12.  Base  Exchangeable  Repair  Costs  ( NSN ) 

13.  Base  Exchangeable  Repair  Costs  (Engine) 

14.  Base  Exchangeable  Modification  Costs  (NSN) 

15.  Base  Condemnation  Spares  Costs/NSN 

16.  Base  Exchangeable  Modification  Costs  (Engine) 

17.  Base  Supply  Management  Overhead  Costs 

18 .  Depot  TCTO  Labor  Costs 

19.  Depot  TCTO  Material  Costs 

20.  Depot  TCTO  Other  Costs 

21.  Depot  Support  General  Costs 

22.  Depot  Labor  Costs 

23.  Depot  Direct  Material  Costs 

24.  Depot  Other  Costs 

25.  Depot  Exchangeable  Repair  Costs  (NSN) 

26.  Depot  Exchangeable  Repair  Costs  (Engine) 

27.  Depot  Exchangeable  Modification  Costs  (NSN) 

28.  Depot  Exchangeable  Modification  Costs  (Engine) 

29.  Depot  Condemnation  Spares  Costs  (NSN) 

30.  Depot  Material  Management  Overhead  Cost 
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equipment.  The  algorithm  addressed  in  this  report  calculates  the 
costs  of  TCTO  kits  issued  in  a  calendar  quarter.  These  costs  are 
developed  separately  for  each  combination  of  aircraft  MDS  and 
depot. 


TABLE  4 


CONTRIBUTION  OF  DEPOT  TCTO  MATERIAL  COSTS 
ALGORITHM  TO  CSCS  OUTPUT  REPORTS 


OUTPUT  REPORT/NUMBER (1) 


COST  ELEMENTS  CONTRIBUTED 
TO  BY  THE  ALGORITHM(2) 3 4 


1.  MDS  Logistics 

Support  Cost/8104 


1.  By  MDS  for  all  bases: 
a.  TCTO  COSTS 

(1)  MATERIAL 

(a)  DEPOT  CL  IV  MODS 

(b)  DEPOT  CL  V  MODS 

(c)  DEPOT  OTHER  MODS 


2.  Total  Base  and  Depot 
Work  Unit  Code  (WUC) 
Cost  Report/ 81 08 


2.  By  MDS: 

a.  TOTAL  COSTS, 


(4) 

TCTO  v  ' 


3 .  Depot  On-Equipment 
Work  Unit  Code  (WUC) 
Costs/8111 


3.  By  MDS  and  ALC: 

a.  DEPOT  TOTAL  COSTS, 


(4) 

TCTO  (  1 


4.  Summary  of  Cost 
Elements/8113 


4.  By  MDS: 

a.  CLASS  IV  MODIFICATIONS, 
DEPOT  TCTO  COSTS,  OTHER 


(1)  CSCS  output  reports  are  assigned  Report  Control  Symbol 
HAF-LEY  (AR)  nnnn,  where  nnnn  is  the  number  in  the  table. 

(2)  Capital  letters  indicate  the  titles  printed  on  the  report. 

(3)  Misnomer.  Should  be  titled  "Depot  Other". 

(4)  Misnomer.  Only  modification  costs  are  reported. 
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3.2.6  Application  to  CSCS  Output  Reports 

Depot  TCTO  material  costs  are  components  of  four  CSC S  reports, 
as  described  by  Table  4.  The  accuracy  of  the  algorithm  output 
will  impact  the  accuracy  of  the  reports  as  a  whole.  However,  the 
total  report  accuracy  cannot  be  addressed  until  all  algorithms  are 
reviewed.  This  will  occur  in  the  final  report  of  this  effort. 
Evaluation  of  the  usefulness  of  the  report  will  also  be  provided 
in  the  final  report  of  this  effort  and  after  ISI  conducts  a  survey 
of  users. 


19 


Thus  all  direct  TCTO  material  costs  should  be  identified  as  kit 


costs.  Elements  35  and  46  of  Table  3  are  the  kit  costs  for  organic 
and  contractor  depot  TCTO  actions,  respectively. 

Finally,  it  can  be  seen  that  the  algorithm  accounts  for  kit 
costs  identified  with  all  non-engine  TCTOs  at  the  MDS  level.* 

The  discussion  of  Section  3.1.3  shows  that  the  algorithm  accounts 
for  Work  Performance  Categories  A,  B,  C,  G,  H,  I,  J,  and  K.  Review 
of  the  definitions  in  Appendix  A  shows  that  these  categories  cover 
all  possible  valid  TCTO  actions. 

In  view  of  the  foregoing  discussion,  Information  Spectrum 
affirms  both  the  accuracy  of  the  source  data  and  the  congruence  of 
the  data  element  definitions. 

3.2.3  Appropriateness  of  Source  Data  as  Inputs 

The  inputs  to  the  algorithm,  suitably  aggregated,  are  the 
outputs.  Hence  ISI  affirms  their  appropriateness. 

3.2.4  Accuracy  and  Appropriateness  of  Algorithm 

Once  again,  since  the  algorithm  aggregates,  not  calculates, 
the  results,  its  appropriateness  is  beyond  question.  Its  accuracy 
is  limited  only  by  the  accuracy  of  reporting  the  input  data.  Both 
characteristics  are  affirmed. 

3.2.5  Directness  of  Costing 

In  this  algorithm,  the  "costing"  is  a  simple  reporting  of 
aggregated  cost  data.  Its  directness  is  affirmed  by  ISI. 

_ 

TCTO  actions  for  exchangeable  components  are  addressed  by  algorithms 
12,  14,  25,  and  27. 


This  section  addresses  various  facets  of  the  algorithm.  The 
discussion  is  structured  to  correspond  to  the  contractual  require¬ 


ments.  Each  aspect  is  either  affirmed  or  rejected.  Rejections 
lead  to  recommendations  in  Section  4.0. 

3.2.1  Appropriateness  and  Accuracy  of  Assumptions  and  Approximations 
Information  Spectrum  finds  that  no  assumptions  or  approximations 

are  used  in  this  algorithm,  so  there  is  nothing  to  affirm. 

3.2.2  Accuracy  of  Source  Data  and  Congruence  of  Data  Element 
Definitions 

Information  Spectrum  was  directed  to  validate  accuracy  of 
source  data  based  on  a  survey  of  published  findings,  reports  of 
audit,  etc.  No  direct  sampling  of  data  was  to  be  performed.  The 
Office  of  VAMOSC  has  indicated  that  direct  validation  of  source 
data  is  planned  for  future  efforts. 

All  source  data  for  this  algorithm  comes  from  the  H036B  data 
system.  No  published  criticism  of  the  accuracy  of  this  data  system 
could  be  found.  Information  Spectrum  affirms  the  accuracy  of  the 
source  data. 

With  respect  to  the  data  element  definitions,  it  is  evident 

that  TCTO  kits  are  included  in  direct  material  costs.  Moreover, 

Section  5-1. a.  of  reference  [32]  says 

"TCTO  kits  shall  contain  all  parts  and  materials, 
except  petroleum  products  such  as  jet  fuels,  lube 
oil,  and  solvents,  required  to  accomplish  the 
instructions  contained  therein  on  one  end  article 
or  item  of  equipment  as  specified  in  the  pertinent 
TCTO. " 


(b)  The  third  character  of  the  Work  Breakdown  Structure 
code  is  not  "2,"  eliminating  engines. 

(c)  The  item  identification  code  includes  alphabetic 
characters,  thus  identifying  an  entire  aircraft,  as 
opposed  to  a  component. 

(d)  The  Work  Performance  Category  code  is  "H,"  identifying 
a  Class  IV  modification. 

(e)  The  desired  calendar  quarter  is  coded. 

For  all  such  records,  the  "Cost,  Unfunded,  Direct  Material,  Modi¬ 
fication  Kit"  (element  35  of  Table  3)  and  "Cost,  Government  Furnished 
Material,  Modification"  (element  46  of  Table  3)  are  added.  These 
sums  are  accumulated  separately  for  each  combination  of  depot  and 


MDS. 


The  procedure  for  accumulating  the  costs  of  material  for 
Class  V  modifications  is  exactly  the  same , ^exac>^:hat  the  Work 
Performance  Category  code  is  "C"  instead  of  "H.” 

There  are  aircraft  TCTO  actions  other  than  modifications. 
Section  2-5  of  reference  [32]  describes  inspection  TCTOs,  which 
may  involve  repair,  but  which  do  not  change  form,  fit,  or  function. 
The  procedure  for  accumulating  the  costs  of  material  for  such  TCTO 
actions  is  again  the  same  as  above,  except  that  now  the  Work  Per¬ 
formance  Category  codes  are  A,  B,  G,  I,  J,  or  K(1). 


(1) 


See  Appendix  A. 
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TABLE  3.  HO  36B  COST  AND  LABOR  HOUR  DATA  ELEMENTS 


024  COST.  PRODUCTION.  OIRECT  LABOR.  CIVILIAN 

029  HOURS.  PRODUCTION.  DIRECT  CIVILIAN  LABOR 

026  COST,  OTHER.  OIRECT  LABOR.  CIVILIAN 

027  HOURS.  OTHER.  DIRECT  CIVILIAN  LABOR 

02B  COST.  PRODUCTION.  DIRECT  LABOR.  MILITARY 

029  HOURS.  PRODUCTION.  OIRECT  MILITARY  LABOR 

030  COST.  OTHER.  OIRECT  LABOR.  MILITARY 

031  HOURS.  OTHER.  OIRECT  MILITARY  LABOR 

032  COST.  PUNOEO.  DIRECT  MATERIAL 

033  COST.  UNFUNOED.  OIRECT  MATERIAL  INVESTMENT 

034  COST.  UNFUNOEO.  DIRECT  MATERIAL  EXCHANGE 

036  COST.  UNFUNOED.  DIRECT  MATERIAL.  MODIFICATION  KITS 

03B  COST.  UNFUNOEO.  OIRECT  MATERIAL  EXPENSE 

037  COST.  FUNOEO.  OTHER  OIRECT 

03S  COST.  UNFUNOEO.  OTHER  DIRECT 

039  COST.  FUNOEO.  OPERATIONS  OVERHEAD 

040  COST.  UNFUNOEO.  OPERATIONS  OVERHE AO 

041  COST.  FUNOEO.  GENERAL  ANO  ADMINISTRATIVE 

042  COST.  UNFUNOEO.  GENERAL  ANO  ADMINISTRATIVE 

043  COST.  CONTRACT  OR  INTERSERVICE 

044  COST.  GOVERNMENT  FURNISHED  MATERIAL.  INVESTMENT 

049  COST.  GOVERNMENT  FURN I SHEO  MATERIAL.  EXCHANGE 

046  COST.  GOVERNMENT  F  URN  I SHEO  MATERIAL.  MODIFICATION 

047  COST.  GOVERNMENT  FURN  t  SHEO  MATERIAL.  EXPENSE 

048  COST.  FUNOEO.  GOVERNMENT  F  URN I SHEO  SERVICES 

049  COST.  UNFUNOEO.  GOVERNMENT  FURNISHED  SERVICES 

090  COST.  FUNOEO.  MAINTENANCE  SUPPORT 

09 t  COST.  UNFUNOEO.  MAINTENANCE  SUPPORT 


(1) 


As  used  in  CSCS  files 


3.1.3  Description  of  Calculation  Procedure 

The  calculation  procedure  reflects  the  structure  of  the  data 
collected  by  the  H036B  data  system.  That  structure  is  established 
by  reference  [29].  Table  3  lists  the  cost  and  labor  hour  data 
elements  collected  by  the  H036B  data  system.  The  element  numbers 
are  as  used  in  CSCS  files,  from  which  this  table  was  extracted. 

Each  H036B  data  record  identifies  a  Work  Performance  Category 
and  a  Work  Breakdown  Structure.  The  codes  for  each  of  these  data 
elements  are  provided  in  Appendix  A.  Only  the  Work  Breakdown 
Structure  Codes  for  aircraft  (first  character  *  "A")  are  provided. 

Reference  [12],  citing  AFLCR  171-24,  defines  a  Class  IV 
modification  as  ”a  modification  necessary  to  correct  equipment 
deficiency  or  installation  deficiency  that  affects  maintainability 
or  reliability  (flight  safety  or  reliability)."  It  defines  a 
Class  V  modification  as  "a  modification  required  to  improve 
system  operational  capability  (change  in  mission)."  In  practice. 
Air  Force  personnel  agree.  Class  IV  modifications  are  assigned 
Work  Performance  Category  code  "H" ,  and  Class  V  modifications  are 
assigned  code  "C."  All  modifications  are  classified  as  either 
Class  IV  or  Class  V. 

With  the  help  of  the  H036B  data  fields  described  above,  and 
others,  the  costs  of  material  for  depot  Class  IV  modifications 
are  aggregated  as  follows.  Records  are  selected  from  H036B  meeting 
the  following  criteria: 


(a)  The  first  character  of  the  Work  Breakdown  Structure 
Code  is  "A,"  identifying  an  aircraft. 


VAMOSC.  In  case  of  any  discrepancies,  information  provided  by 
knowledgeable  personnel  was  accepted  as  most  current,  hence  most 
definitive. 


3.1.1  Calculations 

The  three  kinds  of  depot  TCTO  material  costs  are  not,  in 

fact,  "calculated,"  they  are  simply  aggregated  from  the  input  data 

system.  Thus  there  are  no  calculation  formulas  to  be  displayed. 

For  the  sake  of  uniformity  in  presentation,  this  report  assigns 

names  to  the  three  kinds  of  TCTO  material  costs.  They  are  called 

DEPOT-TCTO-MAT-CL- IV 

DEPOT-TCTO-MAT-CL-V 

DEPOT-TCTO-MAT-OTH 

The  costs  are  aggregated  as  described  in  Sections  3.1.2  and  3.1.3. 

(T  3.1.2  Inputs 

Name:  DEPOT-TCTO-MAT-CL- IV 

Definition:  Cost  of  material  for  Class  IV  modifications 

performed  on  an  aircraft  at  depot  level,  for 
the  selected  depot,  MDS,  and  calendar  quarter. 

Source  System/File:  HO 36B/AHMORA1 
Name :  DEPOT-TCTO-MAT-CL-V 

Definition:  Cost  of  material  for  Class  V  modifications 

performed  on  an  aircraft  at  depot  level,  for 
the  selected  depot,  MDS,  and  calendar  quarter. 


Source  System/File:  H036B/AHMORA1 
Name :  DEPOT-TCTO-MAT-OTH 

Definition:  Cost  of  material  for  non-modification  TCTO 

actions  performed  on  an  aircraft  at  depot  level, 
for  the  selected  depot,  MDS,  and  calendar  quarter. 

/A';/  Source  System/File:  HO 36B/AHMORA1 
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3.0  ALGORITHM  ANALYSIS 


The  previous  section  described  the  general  analysis  procedures 
applied  to  all  algorithms.  This  section  presents  the  results  of 
applying  those  procedures  to  the  algorithm  for  Depot  TCTO  Material 
Co sts. 

Section  3.1  provides  a  detailed  description  of  the  algorithm 
and  of  the  input  data  it  uses.  Section  3.2  provides  a  critique, 
structured  to  correspond  to  the  contractual  requirements.  Section 
4.0  makes  recommendations  for  solutions  of  problems. 

3.1  Algorithm  Description 

In  the  following  description  COBOL-type  data  names  are  used 
to  express  the  algorithm  outputs  and  their  components.  The  avail¬ 
able  source  documentation  does  not  provide  the  actual  data  names 
used  by  the  CSCS  programs.  They  are  presumably  different  from 
those  used  in  this  report. 

There  are  three  kinds  of  TCTO  actions:  Class  IV  modifications. 
Class  V  modifications,  and  "other."  The  three  kinds  are  explained 
in  Section  3.1.3  below.  Although  the  User's  Manual  identifies  a 
single  algorithm  as  "Depot  TCTO  Material  Costs,"  in  fact  the  CSCS 
calculates  and  presents  material  costs  separately  for  the  three  cases 

The  calculation  formulas  are  stated  in  Section  3 ..1.1.  The 
input  data  elements  and  their  sources  are  provided  in  Section  3.1.2. 
The  calculation  is  described  verbally  in  Section  3.1.3.  Unless 
otherwise  noted,  the  descriptions  are  based  on  references  [1] ,  [2] , 
and  [3] ,  and  on  direct  discussion  with  personnel  of  the  Office  of 


2.4  Problem  Resolution 

Whenever  a  significant  deficiency  was  recognized  in  one  of 
the  algorithms,  one  or  more  proposed  solutions  were  developed. 

This  was  a  creative  analytic  process  for  which  few  guidelines 
could  be  proposed  in  advance.  Certainly  it  depended  on  fami¬ 
liarity  with  the  various  existing  Air  Force  data  reporting  and 
processing  systems.  Proposed  solutions  were  discussed  with  per¬ 
sonnel  of  the  Office  of  VAMOSC,  and  revised  as  appropriate. 
Recommended  solutions  were  expressed  in  the  form  of  contributions 
to  a  draft  Data  Automation  Requirement  (DAR)  when  these  would  be 
applicable. 

2.5  Documentation 

The  documentation  of  the  analysis  of  each  algorithm  was  a 
crucial  part  of  the  effort.  Emphasis  was  placed  on  making  it 
thorough,  clear,  and  unambiguous.  In  the  documentation,  every 
assertion  was  substantiated.  This  was  done  by  reference  to  source 
documentation,  by  explicitly  expressed  application  of  the  experi¬ 
ence  and  judgment  of  the  contractor,  or  by  citation  of  information 
provided  by  cognizant  Air  Force  personnel.  In  the  last  case,  the 
information  was  supported  by  documentation  identifying  the  source, 
the  date,  and  the  information  provided. 


that  for  a  single  reporting  period  all  maintenance 
labor  is  overhead  and  none  is  direct.  Also  try  the 
reverse  assumption.  If  an  assumption  of  an  extreme 
input  leads  to  an  illogical  result,  the  algorithm  is 
flawed. 

Task  4  of  Section  C-2,  c  of  the  contract  speaks  of 
appropriate  statistical  techniques  to  confirm  or  repu¬ 
diate  each  algorithm.  Statistical  techniques  could 
confirm  or  repudiate  only  statistical  hypotheses  as 
assumptions.  (Use  of  an  average  does  not  constitute 
an  assumption. )  Accordingly,  statistical  techniques 
apply  to  confirmation  or  repudiation  of  an  algorithm 
only  to  the  extent  that  statistical  hypotheses  can  be 
developed. 

(f)  As  each  algorithm  is  considered,  ensure  that  the  costs 
do  not  overlap  others  already  accounted  for.  (In  some 
cases  an  overlap  may  be  necessary  and  desirable.  Where 
this  occurs,  the  overlap  will  be  noted.) 

(g)  In  each  CSCS  output  report,  identify  the  data  elements 
incorporating  the  output  of  the  algorithm,  so  that  a 
final  assessment  of  report  accuracy  can  be  made  for 
each  output  report. 

(h)  Consider  alternative  sources  of  input  data  for  the 
algorithm.  Also  consider  more  direct  cost  assignments 
than  those  incorporated  in  the  algorithm. 
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Some  explicit  techniques  which  were  generally  used  in  concept 
validation  are  listed  below. 

(a)  Consider  how  the  cost  element  would  be  calculated  if 
there  were  no  constraints  on  resources.  (For  example, 
suppose  the  CSCS  could  identify  the  pay  grade  and  hours 
worked  of  each  individual  involved  in  a  maintenance 
action. ) 

(b)  Identify  assumptions*  incorporated  into  the  algorithm. 
Generally  this  procedure  will  identify  the  real 
constraints  which  affect  the  approach  in  (a)  above. 

(c)  Identify  approximations  incorporated  into  the  algorithm. 
For  instance,  one  such  approximation  is  the  use  of  an 
average  labor  rate  for  each  aircraft. 

(d)  Study  each  approximation  for  possible  sources  of  error. 
Some  examples  are  biases  introduced  by  editing  proce¬ 
dures,  obsolete  data,  or  inappropriate  application. 
Whenever  feasible,  estimate  the  likelihood  of  these 
errors  by  reviews  of  the  literature  and  contact  with 
cognizant  personnel. 

(e)  Test  the  algorithms  under  conditions  of  assumed  extreme 

values  for  the  inputs.  For  instance,  in  evaluating  the 

* 

algorithm  for  base  maintenance  overhead  c.osts,  assume 

E  Note  that  assumptions,  approximations,  and  allocations  are 
■  different  concepts,  although  in  some  cases  the  boundaries 
between  them  are  not  sharp.  ISI  has  recognized  few  assump¬ 
tions  in  the  algorithms,  but  many  approximations  and  alloca¬ 
tions. 
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input  data  element  and  of  the  system  providing  it  was  provided 
by  the  User's  Manual  (reference  [1]).  This  identification  was 
refined  by  identification  of  a  particular  file  within  the  source 
system  and  the  structure  of  the  file  as  described  in  both  the 
CSCS  System/Subsystem  Specification  and  in  the  Memoranda  of 
Agreement.  The  Memoranda  of  Agreement  have  been  established  be¬ 
tween  the  Office  of  VAMOSC  and  the  Offices  of  Primary  Responsi¬ 
bility  (OPR)  for  the  systems  providing  the  input  data.  Any 
inconsistencies  or  voids  were  identified  and  resolved  through 
contact  with  the  Office  of  VAMOSC  and/or  implementing  personnel. 

Whenever  appropriate,  input  data  element  definitions  were 
further  refined  by  tracing  the  elements  back  to  their  sources 
through  the  reference  data  provided.  If  these  were  inadequate, 
the  OPRs  were  contacted  directly  for  clarifications.  In  tracing 
the  data  back  to  their  origins,  possible  sources  of  data  con¬ 
tamination  were  considered.  Information  on  the  likelihood  and 
significance  of  such  contamination  was  collected  from  cognizant 
personnel  and  from  published  references. 

2. 3  Concept  Validation 

The  two  steps  above  established  exactly  what  the  algorithm 
does.  The  third,  and  most  critical  step,  considered  the  validity 
of  the  procedure.  It  depends  on  the  ability  of  the  analyst  to 
translate  mathematical  formulas  and  data  processing  techniques 
into  meaningful  concepts. 
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2.0  ANALYSIS  PROCEDURES 


In  order  to  verify  and  validate  the  CSCS  algorithms,  a  set 
of  analysis  procedures  applicable  to  all  of  the  algorithms  was 
established.  These  procedures  were  then  applied  to  each  algorithm. 
This  section  describes  the  analysis  procedures,  without  reference 
to  the  specific  algorithms  addressed  by  this  report. 

The  algorithm  analysis  process  consists  of  five  portions, 
described  in  the  following  sections. 

2.1  Algorithm  Description 

The  algorithms  are  described  in  references  [1],  [2],  and  [3]. 
These  descriptions  are  not  identical.  In  general  they  supplement, 
rather  than  contradict  each  other.  The  first  two  describe  what 
the  system  is  to  achieve;  the  third  describes  the  system  design 
to  do  so. 

None  of  these  descriptions  provides  the  combination  of  level 
of  detail  and  clarity  of  concept  required  for  this  validation 
effort.  The  first  step  in  the  analysis  methodology  was  the 
generation  of  such  a  description.  The  descriptions  in  the  three 
reference  sources  just  cited  were  made  explicit.  When  necessary. 
Air  Force  personnel  involved  in  implementation  of  the  D160B  sub¬ 
system  were  contacted  for  clarification. 

2.2  Input  Data  Definitions 

Closely  related  to  the  first  step  was  the  clarification  of 
the  definitions  of  the  input  data.  The  identification  of  each 
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4.0  RECOMMENDATIONS 


Section  3  has  reviewed  the  Depot  TCTO  Material  Cost  algorithm 
All  aspects  of  the  algorithm  have  been  affirmed.  Information 
Spectrum  recommends  that  it  be  retained  in  its  present  form. 

4.0a  Office  of  VAMOSC  (OOV)  Comments 
Concur. 
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Jun 
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D143F/ARC/D160B-A 
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D160/D160B 

11 

Jun 

1982 

G004L/M024B/D160B-A 

30 

May 

1980 

G004L/M024B/D160B-B 

30 

May 

1980 

G004L/M024B/D160B-C 

5 
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1981 
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0013/BDN/D160B 


22  Jul  1982 
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WORK  PERFORMANCE  CATEGORIES 

Code  A— Overhaul.  The  disassembly,  test,  and  inspec-  end-items,  assemblies  or  subassemblies  to  obtain  parts  or 


on  of  the  operating  components  and  the  basic  structure 
,  determine  and  accomplish  the  necessary  repair,  re¬ 
build,  replacement  and  servicing  required  to  obtain  the 
desired  performance.  It  is  considered  to  be  synonymous 
with  the  terms  “rework”  or  “rebuild.” 

Code  B— Progressive  Maintenance.  A  predetermined 
amount  of  work  that  presents  a  partial  overhaul  under  a 
program  that  permits  the  complete  overhaul  to  be  accom¬ 
plished  during  two  or  more  time  periods.  It  is  considered 
synonymous  with  the  terms  “cycle  maintenance,”  “re¬ 
stricted  availability,”  “preventive  servicing,”  or  “recondi¬ 
tion.” 

Code  C— Conversion.  The  alteration  of  the  basic  charac¬ 
teristics  of  an  item  to  such  an  extent  as  to  change  the  mis¬ 
sion,  performance  or  capability. 

Code  D — Activation.  The  depreservation,  servicing,  in¬ 
spection,  test  and  replacement  of  assemblies  or  subassem¬ 
blies  as  required  to  return  an  item  from  storage  or  in¬ 
active  pool  status  to  operational  use. 

Code  E — Inactivation.  The  servicing  and  preservation 
of  an  item  prior  to  entering  storage  or  an  inactive  pool. 

fj*de  F— Renovation.  The  proof  and  test  evaluation  and 
rework  of  ammunition  or  ordnance  items  as  required  for 
retaining  their  desired  capability. 

Code  G— Analytical  Rework.  The  disassembly,  test  and 
inspection  of  end-items,  assemblies  or  subassemblies  to 
determine  and  accomplish  the  necessary  rework,  rebuild, 
replacement,  or  modification  required.  It  includes  the 
technical  analysis  of  the  findings  and  determination  of 
maintenance  criteria.  Includes  prototype  tear-down, 
analysis  and  rework  of  an  item  to  determine  job  and  ma¬ 
terial  specifications  on  a  future  workload. 

Code  H—  Modification.  The  alteration  or  change  of  the 
physical  makeup  of  a  weapon/support  system,  subsystem, 
component,  or  part  in  accordance  with  approved  techni¬ 
cal  direction. 

Code  I— Repair.  Action  taken  to  restore  to  a  serviceable 
condition  an  item  rendered  unserviceable  by  wear, 
failure,  or  damage. 

Code  J— Inspection  and  Test.  The  examination  and 
testing  required  to  determine  the  condition  or  proper 
v\  'turning  as  related  to  the  applicable  specifications. 

Code  K— Manufacture.  The  fabrication  of  an  item  by 
application  of  labor  and/or  machines  to  material. 

Coda  L— Reclamation.  The  authorized  processing  of 


components  that  are  to  be  retained  in  the  inventory  prior 
to  taking  disposal  action  on  the  remaining  items.  Covers 
demilitarization  actions  on  items  prior  to  disposal  when 
the  demilitarization  is  incidental  to  the  reclamation. 

Code  M— Storage.  The  inspection,  represervation  and 
maintenance  in  a  storage  status  of  weapons  and  equip¬ 
ment  items  as  well  as  their  subsystems  and  components 
in  the  supply  system. 

Code  N— Technical  Assistance.  The  use  of  qualified 
depot  maintenance  personnel  to  provide  technical  infor¬ 
mation,  instructions,  or  guidance,  or  to  perform  specific 
work  requiring  special  skills,  for  operational  activities  or 
other  maintenance  organizations.  Includes  all  demilitari¬ 
zation  other  than  the  incidental  to  reclamation  (Code  L). 

Code  0— Not  Used. 

Code  P— Programming  and  Planning  Support.  In¬ 
cludes  consolidated  long-range  workload  scheduling  and 
resource  utilization:  centralized  maintenance  program¬ 
ming  and  planning  for  support  of  all  levels  of  mainte¬ 
nance;  all  logistics  support  exclusive  of  engineering  effort 
in  the  programming  and  development  of  maintenance 
support  requirements  for  weapon  systems  and  weapons 
support  activities. 

Code  Q — Maintenance  Technical  and  Engineering 
Support.  Includes  the  technical  and  engineering  effort  in 

development  of  maintainability  concepts  and  the  maint£_ - 

nance  portion  of  logistics  plans  dealing  with  future  and 
present  weapons  and  equipment.  Includes  regional  main¬ 
tenance  representatives,  field  liaison,  maintenance  tech¬ 
nicians,  contract  technical  services,  contract  engineering 
services  in  direct  support  of  maintenance,  contract  tech¬ 
nicians  and  engineers  in  direct  support  of  maintenance. 

Code  R— Technical  and  Engineering  Data.  Includes 
the  preparation  of  technical  and  engineering  data  as  ap¬ 
plied  to  all  categories  of  equipment.  Includes  engineering 
drawings,  wiring  diagrams,  technical  orders,  engineering 
technical  standards,  technical  handbooks,  technical  bulle¬ 
tins  and  similar  publications.  Provides  for  the  prepara¬ 
tion,  editorial  review  and/or  revision  of  equipment  publi¬ 
cations  pertaining  to  the  operation,  repair  and  repair 
parts  support  of  DOD  materiel.  Preparation  includes,  but 
is  not  limited  to,  the  consolidation  of  source  data,  draw¬ 
ings  snd  art  work,  editing,  preparation  of  final  printable 
copy  and  printing.  Includes  significant  identifiable  effort 
within  organic  maintenance  or  at  other  DOD  specialized 
support  functions  to  produce  data  in  support  of  mainte¬ 
nance,  such  as  cryptographic  or  test  equipment  support 
data. 

Code  S— Technical  and  Administrative  Training.  In- 
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eludes  educational  units  conducting  maintenance  train*  depot  maintenance  activities  in  support  of  the  depot 

ing  and  training  associated  with  new  weapon  systems  or  maintenance  operation  is  not  maintenance  support,  but  a 

support  systems  which  have  been  or  will  be  introduced  part  of  the  depot  maintenance  operation, 

into  the  DOD  inventory.  At  depot  maintenance  activities, 

'**"•>  only  training  associated  with  new  equipment  is  mainte*  Code  T— Nonmaintenance  Work.  Used  to  assure  corn- 

nance  support.  This  training  is  separately  funded  by  spe-  pleteness  of  maintenance  work  force  reporting, 
cific  funding  documents.  Other  training  accomplished  at 
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Aircraft 

Fighters 

Basic  Aircraft  (Airframe) 

Engine 

Aircraft  and  Engine  Accessories  and  Components 
Electronics  and  Communications  Equipment 
Armament 
Support  Equipment 
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Bombers 

Same  as  for  Fighters 
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Same  as  for  Fighters 
Trainers 

Same  as  for  Fighters 
Utility 

Same  as  for  Fighters 
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(1)  (2)  (3) 
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1 

1 

2 

3 

4 
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2 

3 
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